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Abstract 

We  look  at  programming  with  inductive  and  co-inductive  datatypes,  which  2ire 
inspired  theoretically  by  initial  algebras  and  final  co-algebras,  respectively.  A 
predicative  calculus  which  incorporates  these  datatypes  as  primitive  constructs 
is  presented.  This  calculus  allows  reduction  sequences  which  eire  significantly 
more  efficient  for  two  dual  classes  of  common  programs  than  do  previous  calculi 
using  similar  primitives.  Several  techniques  for  programming  in  this  calculus 
are  illustrated  with  numerous  examples.  A  short  survey  of  related  work  is  edso 
included. 


This  research  was  supported  in  part  by  the  Office  of  Naval  Research  and  in  part 
by  the  Defense  Advanced  Research  Projects  Agency,  monitored  by  the  Office  of  Naval 
Research  under  Contract  N00014-84-K-0415,  ARPA  Order  No.  5404,  and  in  part  by 
the  ONR  Graduate  Fellowship  Program. 

The  views  and  conclusions  contained  in  this  document  are  those  of  the  author 
and  should  not  be  interpreted  as  representing  the  official  policies,  either  expressed  or 
implied,  of  ONR,  DARPA  or  the  U.S.  government. 


Keywords;  Data  types  and  structures,  program  and  recursion  schemes, 
lambda  calculus  and  related  systems,  induction,  co-induction,  initial  algebras, 
final  co-algebras 


1  Introduction 


This  paper  explores  programming  with  inductive  and  co-inductive  datatypes. 
Type  expressions  using  the  fi  type  constructor  represent  finitely  representable 
inductive  types  (e.g.,  natural  numbers,  lists),  while  those  using  u  represent 
countably  inhnite  or  potentially  infinite  co-inductive  types  (e.g.,  potentially  infi¬ 
nite  streams,  infinite  depth  binary  trees).  Each  (co-)inductive  type  is  associated 
with  operators  to  build  and  manipulate  terms  of  these  types. 

Encodings  of  such  types  in  previous  calculi  have  suffered  from  efficiency 
problems  which  prevent  them  from  being  as  useful  in  practice  as  desired.  The 
typical  example  is  that  of  the  predecessor  function  on  the  common  Church  nu¬ 
meral  encoding  in  Fj,  which  requires  linear-time,  as  shown  by  Parigot  [24].  Most 
encodings  in  other  calculi  are  closely  related  and  suffer  the  same  problem.  Our 
calculus  allows  similar  encodings  of  data  types,  but  the  calculus  offers  exten¬ 
sions  admitting  definitions  of  constant-time  pred  and  cdr,  and  related  efficiency 
improvements. 

Previous  work  has  concentrated  on  inductive  types.  Very  few  examples  of 
co-inductive  functions  have  been  given,  so  that  their  usefulness  in  practice  is  in 
question.  This  paper  explores  the  duality  of  inductive  and  co-inductive  types 
and  presents  a  number  of  examples  to  attempt  to  show  the  usefulness  of  co- 
inductive  types. 

Induction  and  co-induction  as  presented  here  are  obviously  less  powerful 
than  recursion,  as  they  guarantee  termination.  So,  an  essential  question  is 
whether  these  concepts  are  powerful  enough  for  practical  programming.  This  is 
the  motivation  for  our  extensive  look  at  examples  within  the  calculus. 

These  (co-)inductive  type  constructors  are  inspired  by  initial  algebras  and 
final  co-algebras  [8,  9,  19]  of  category  theory.  Some  examples  of  this  paper  use 
simple  commuting  diagrams  to  help  explain  the  definition  of  some  functions  in 
the  calculus.  A  basic  knowledge  of  category  theory  will  be  helpful,  but  not 
necessary,  to  the  reader. 

A  summary  of  this  theoretical  motivation  is  given  in  Section  2.  The  calculus 
is  introduced  in  section  3,  with  examples  of  inductive  and  co-inductive  terms  in 
Sections  4  and  5.  In  Section  6,  related  work  is  discussed.  The  appendices  give 
additional  details  for  interested  readers. 


2  Theoretical  Inspiration 

This  section  provides  s  theoretical  motivation  or  inspiration  for  the  calculus  as 
presented  in  Section  3.  As  such,  it  also  serves  as  a  beginning  point  for  developing 
a  model  for  the  calculus.  More  pragmatically,  simple  commuting  diagrams  lead 
to  methods  for  programming  in  the  calculus. 

Assume  that  there  exists  an  appropriate  category  C  of  types^ ,  where  arrows 

'Some  featurea  of  such  a  category  are  Hiscuased  in  [2,  6). 
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represent  functions  from  one  type  to  another  and  composition  is  function  com¬ 
position.  We  then  look  at  F-algebras,  for  functors  F  :  C  —*  C.  An  F-algebra 
is  a  pair  (r,  g)  consisting  of  an  object  r  :  C  and  a  map  g  :  F(r)  — ►  t.  An  F- 
homomorpkism,  an  arrow  in  the  category  of  i^-algebras,  is  a  C-arrow  such  that 
the  following  diagram  commutes. 


If  (t,  is  an  initial  F-algebra,  then  there  exists  a  unique  h  for  any  given  choice 
of  (r',/).  Labelling  the  initial  F-algebra  as  {p(F),in{F})  and  the  unique  h  as 
R{F}[r]/  to  emphasize  their  dependencies,  we  obtain  the  commuting  diagram 


in{F}  / 


R{F][r^f 

When  the  above  arguments  are  dualized,  we  obtain  the  final  F-co-algebra 
{i/(F),out{F})  such  that  the  following  diagram  commutes  for  emy  choice  of 

(r'.n- 


out{F} 


G{F}[r']/ 


■u{F) 
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The  following  theorems  and  corollaries  are  to  establish  motivation  for  some 
of  the  equality  judgments  of  the  calculus.  Proofs  ate  given  only  for  inductive 
cases,  as  the  co-inductive  cases  are  analogous. 

The  first  theorem  is  /3'like  and  shows  the  main  interaction  of  the  induction 
morphisms.  The  second  gives  t^like  equalities. 

Theorem  1  Principle  of  induction:  (R{f}[r]/)  o  in{F}  =  /  o  F(R{F}[r]/) 
and  of  co-induction:  out{F}  o  (G{F}[t]/)  =  F(G{F}[t]/)  o  /. 

Proof:  Follow  from  the  commutativity  of  the  preceding  diagrams.  □ 

Theorem  2  R{F}[/i(F)]m{F}  =  and  G{F)[i/(F)]out{F}  =  Id''<^^'>. 

Proof:  Follow  from  the  initially  (finality)  of  the  F-(co-)algebra  and  commu¬ 
tativity.  □ 


Theorem  3  m{F}  and  out{F}  are  isomorphisms. 


Proof:  We  show  that  in{F}  has  left-  and  right-inverses.  Consider  the  following 
diagram,  where  both  squares  commute: 

F[/i(F)] - F[F[m(F)]]  F[^(F)] 


m{F} 


F(m{F}) 


in{F} 


- i - -  F(p(F)]  -  A*(F) 

By  the  definition  of  sui  algebra,  !  =  R{F}[F[/i(F)]]F(in{F})  is  the  unique 
map  such  that 


!  o  in{F}  =  F(in{F})  o  F(!)  =  F(in{F}  o  !). 

Since  the  inner  squares  commute,  so  does  the  outer  rectangle.  Then,  by  initiality, 

in{F}  o  !  =  Id>‘^^\ 


Furthermore, 


!  o  in{F}  =  F(in{F}  o  !)  =  F{rd'*^^^)  =  /d^W^')l. 

But  these  equations  simply  mean  that  !  is  a  left-  and  right-inverse  of  in{F}, 
and  thus,  that  in{F}  is  an  isomorphism.  □ 
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Corollary  1  There  exist  unique  morpkisms  and  out~^{F}.  And 

these  inverses  are  expressible  in  terms  of  the  other  (co-)inductive  morphisms 
as  R{F}[Fyi{F)]]{F{m{F}))  and  G{F}[F[i/(F)]](F(out{f’})),  respectively. 

Example  1  For  F{X)  =  1  +  in{F}  is  the  mapping  [zero,succ].  Its  in¬ 
verse,  in“^{F},  is  related  to  the  mappings  zero?  and  pred.  Details  are  found  in 
Example  11. 

3  The  Calculus 

The  calculus  is  based  upon  a  restricted  version  of  [11].  The  higher  kinds 
of  that  calculus  are  omitted  to  avoid  complications  that  arise  between  type 
constructor  application  and  the  positivity  requirement  of  /i  and  .  The  explicit 
set  injection  is  also  omitted,  for  readability.  Thus,  this  calculus  is  called 
for  “mini-A^^  with  n  and  i/”.  The  choice  of  calculus  for  a  base  is  not  critical; 
e.g.,  the  Calculus  of  Constructions,  Fj,  and  variants  of  F2  have  been  used  in 
other  work. 


3.1  Syntax 

Given  denumerable  seta  of  variables  typevar  and  termvar,  the  calculus  is  defined 
by 


X  €  typevar 
T  €  types 
u  €  typecon^ 
<T  G  typeschemes 
X  G  termvar 
t  G  terms 


r  G  contexts 


AT  I  1  I  n  X  T2  I  n  -f  r2  I  r  -f  /  I  fx(u)  |  i'(u) 
XX. r  s.t.  -'Neg(X,r) 

T  \  <ri -x.  \  (Ti  ■¥  <T2  \  <r  (t'  \  'iX.<T 

1 1  *  I  (fuh)  I  I  Tfzt  I 

inFt  I  inr't  |  case(t,ti,f2)  | 

Ax  :  <T.t  I  ti  I  AX.t  1  t[T]  I 
in{«}  I  in~^{M)  |  R{«}[r]t  | 
out{u}  I  OUt”^{u}  I  G{«}[T]t 
0|r,v:or 


where  Neg(X,r)  (Pos(X,r))  holds  if  X  occurs  “negatively”  (“positively”)  in 
t: 

^The  implications  are  discussed  briefly  in  Section  8. 

®The  weak  notion  of  “type  constructor”  used  here  corresponds  to  a  constructor  of  kind 
Type  — »  Type .  Also,  fi  and  1/  can  be  informally  considered  type  constructors  of  kind  ( Type  — » 
Type)  Type. 
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Neg{X,  X)  =  Ncg{X,  1)  =  false 

Neglx,  Ti  X  Ti)  =  Neg{X,  n  +  rj)  =  Neg{X,  n)  V  Neg(X,  T2) 

Negix,  T  —  r')  =  Pos{Xy  t)  V  Neg{X,  t') 

Neglx,  niXX.T))  =  Neg{X ,  u(\X  .t))  =  faUe 

NegiX,  /i(Ay.r))  =  NegiX,  v{\Y.t))  =  (X  #  V)  A  Neg{X,  r),  if  X  #  K 

Fos(X,X)  =  fr«e 
Po5(X,  1)  =  /fl/se 

P(7«(X,  ri  X  r2)  =  Pos(X,  n  +  ra)  =  Pos(X,  n)  V  Pos(X,  T2) 

Poslx,  r  — ►  r')  =  Negix,  r)  V  Pos(X,  r') 

Pos(A’,p(AX.r))  =  Pos(X,  i/(AX.r))  =/afce 

Pos(X,  /i(Ay.r))  =  Pos(X,  KAy.r))  =  (X  #  y )  A  Pos{X,  T),ifX^Y 

and  where  contexts  are  taken  to  be  sets,  with  the  comma  as  the  extension 
operator. 

The  addition  of  the  families  of  constants  in"^{u}  and  out“^{u},  along  with 
the  association  reductions  in  Section  3.4,  is  a  primary  contribution  of  this  paper. 

Here,  we  find  the  notation  n(AX.r)  (and  similarly,  i/(AX.r))  more  conve¬ 
nient,  but  it  is  equivalent  to  the  more  common  notation  /iX.r. 

3.2  Meta-notation 

For  readability,  we  make  extensive  use  of  notational  definitions  using  the  symbol 
=.  For  example,  Id^  ~  Ax  :  <r.x,  =  Au  :  l.f.  Also,  adter  the  first  examples, 

we  omit  type  information  when  it  is  clear  from  context. 

In  the  examples,  we  express  desired  properties  of  functions  via  equivalences. 
Observational  equivalence  between  terms  is  denoted  by  =!.  As  usual,  t  2  t'  iff 
P[t]  and  P[t']  evaluate  to  the  same  vadue^,  for  all  contexts  P[]  of  type  Bool. 

Capture-avoiding  substitution  is  denoted  A[jB/C].  Type  constructor  appli¬ 
cation  «  r  is  shorthand  for  its  /?-reduction,  u(t/X] 

3.3  Type  judgments 

Type  judgments  of  the  form  F  b  t ;  state  that  t  is  a  term  of  type  <t. 

r,t  Fh*:! 

F  I-  ti  :  (Tj  i  =  1,2  F  K  :  (Ti  X  (T2 _ i=l,2 

r  ^  {Ujt7)  -(Ti  X  0-2  r  h  iTit  :  tr,- 

F  h  t  :  O’! _  _ F  I-  t  :  (72 _ 

F  I-  iny’t  :  (Ti  +  <r2  F  h  inr^'t  :  (Ti  <72 

*See  Section  3.4  for  the  definitions  of  evaluation  and  values. 
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r  I-  t :  <Ti  +  <T2 _ r  t-  t,  q-j  — >  O’ 

r  h  caae(t,ti,t2)  :  (t 


•  =  1,2 


r,g  :  O'  t-  t  : 
r  h  (Ax  :  cr.t)  :  a  —*  <t* 


T  h  ti  :  <r  -*  o'  ri-t2:o' 
T  ^  ti  t2  :  (t' 


rht:<r 
T  h  AJC.t :  VX.o 

r  h  in{u}  :  (ti  fi(u))  —  /i(u) 
r  h  :  /i(«)  (u  fi(u)) 

T\-t:(uT)-*T 

r  h  R{u}[r]f  ;  /i(u)  — »  r 

Type  and  type  constructor  equality 


r  t-  t  :  VX.ff 
r  1-  t[r]  :  o[r/X] 

r  H  out{u}  ;  i/(u)  — ►  (u  u(u)) 

r  H  out~^{u}  :  (u  i/(u))  — ► !'(«) 

r  h  t  :  T  — m  r 
r  h  G{u}[r]t :  r  — ►  v(u) 

is  simply  a-equality.® 


3.4  Operational  semantics 

The  values  of  the  calculus  are  the  closed  terms  of  the  form 

V  €  values  ::=  *  \  (vi,V2)  I  inl't;  [  |  Ax  ;  a.t  \  AX.t  \ 

ui{u}  I  in{u}v‘|  |  R{u}[r]w  | 

out{u}  I  out“^{u}  I  I  G{u}[t]v  |  G{u}[r]vi  V2 

These  are  the  values  of  the  A^^  core,  plus  the  “partially  applied”  (co-)inductive 
forms. 

The  one-step  evaluation  fimction  — ►  is  defined  upon  well-typed  terms  by 
the  following  judgments.  Its  reflexive  and  transitive  closure  is  denoted  by 
Although  lazy  products  amd  co-products  would  also  improve  efficiency,  we  use 
eager  (co-)products  and  call-by-value  which  are  sufficient  for  the  desired  effi¬ 
ciency  results  of  induction  and  co-induction. 

ti  — >  t'l  <2  — ►  <2  t — *t'  i=l,2 

{t'l  ,t7)  (v,  h)  (t,  i'i)  ^it  TTit' 


t  — t  — 
inrt  — ►  inrt'  inr'^t  — ►  inr't' 


^In  partictilar,  the  calculus  does  not  have  the  equality  P  H  m(u)  st  u(m(u))  as  found 
in  many  object-oriented  type  systems  using  “recursive”  types.  Here,  these  two  expressions 
denote  distinct,  but  isomorphic  types,  where  in{u}  loid  in~*  {u}  are  coercions. 
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_ i  — »-t* _ 

case(t,ti,t2)  — case(t',ti,ta) 

_ <1-^*1 _ 

case(v,  <1 ,  <2)  — ‘  ease(v,  ,  <2 ) 

_ ^2  — *•  ^2 _ 

case(t; ,  wi ,  <  2)  — ►  case(r,  t?i ,  t  j ) 

t  — -t'  t  — t  — 

t  t"  — ►  t' t"  V  t  — ►  V  t'  t[ti]  — ►  t'[«] 

t  — *i'  _ t  — >t' _ 

m{«}f  — ►  in{«}<' 

t  — _ t  — >t' _ 

out{u}t  — ►  out{«}t'  out~^{u}t  — ►  out~^{«}t' 

_ t  — _  _ t  — yf _ 

R{„}[r]t  — .  R{u)[T]f  G{u}[r]t  —  G{u}[T]t' 

case(inl*’u,vi,V2)  — *  vi  v  case(inr''v,vi,t;2)  — ►  va  v 

"■•(vi.wa)  — ►  Vi 

(Ax  :  (AX-OM  — ^ 

— ►  v  out{ti}(out”^{«}t;)  — ►  v 

R{u}[r]t;i  (in{«}t;2)  — ►  wi(^{«}W«)]M  (R{«}[r]ri)  va) 

out{Ti}(G{u}[r]ui  Vs)  — ►  ^{ti}[r][j/(u)]  (G{’»}[r]vi)  (ri  vs) 

These  last  t'  o  rul«  represent  infinite  families  of  reductions  indexed  by  u,  since 
/  <  is  meta-notation  defined  by  induction  on  the  structure  of  u  as 

below.® 

Together,  the  type  constructor  «  and  ^{u}[7'i][t^]  /  f  correspond  to  the 
object  (type)  morphism  and  map  (term)  morphism  of  the  functor  $  of  Section 
2.  Since  the  latter  is  defined  in  terms  of  the  former  It  is  sufficient  to  index  the 
terms  such  as  in{u}  as  such,  rather  than  indexing  by  the  functor  as  in  category 
theory. 

The  definition  of  is 

*This  definition  is  adapted  in  conjunction  with  Dttniel  Leivant  and  is  a  correction  of  the 
analogous  definitions  in  Hagino  [8,  9]  and  Leivant  [12]. 
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if  «  =  XX. X,  f  t 

if  u  =  XX.Y,X  ^Y,t 
if  u  =  XX.l,  * 

if  u  =  XX.ri  X  ri,  <<f  }[ri]H  /  (tiO, .7^2}^]^]  / 

if  «  =  AX.t^  +  t*2,  case(<,  Aari  :  T^[Ti/X].inl(${AA’.T{}[Ti][r2]  /  xi), 

Xx2  :  T^(Ti/X].mr(${AA’.T^}[ri][r2]  /  X2)) 

if  u  =  AX.Ti  — ►  72,  Ax  :  T^[7^/Af]. 

n>^X.T'2}[n][Ti]  f  (t(5{AX.7^}[ri][r2]  /  x)) 
if  u  =  XX.fiiu')  R{«'[ri/Af]}[/i(ti'[r2/X])] 

emd  y  fresh,  (Ax  :  u'[Ti/Af]  ii{u'[t-iIX]). 

in{u'[T2  /,Y]} 

mXX.u'  y}[ri]H  /  xMu'[r2/X])/Y]) 

t 

if  «  =  XX.u{u')  G{u'[T-i/X\}[vW[TjX])] 

and  y  fresh,  (Ax  :  v{u'[ti/ X]). 

(${AA-.«'  y}[n][r2] 

/  (out{«'[ri/x]}x))(i/(«'[n/Ar])/y]) 

t 

where  the  definition  of  ^{u}[ri]lT^]  f  ths  almost  identical,  except  that  $  and  $ 
are  interchanged: 

ifu  =  Ax.y,x  jty,  t 
if  u  =  AAf.l,  ♦ 

if  u  =  \X.t[  X  7^.  (^{AX.r(}[ril[T5]  /  (xif),${AA:.r^2}[n][r2]  /  (^2<)) 

if  u  =  XX.t{  +  7^,  case(t,  Axi  :  i^[7v/A’].inl(${AAf.Ti}[ri][r2]  /  xi), 

Ax2  :  T^[7^/X].inr(${AX.7^}[ri][T2]  /  X2)) 

11  u  =  AAf.r(  — >  7^  Ax  :  r([ri/X]. 

*{AX7^}(ri][75]  /  (f(«{AA-.r(}[ri][r2]  /  x)) 
if  u  =  AX.p(«')  R{ti'[T5/An}[/i(«'[ri/X])] 

and  y  fresh,  (Ax  ;  «'[7^/X](^(u'[ri/X])] 

(<t{AAf.«'  y}[rx][r2]  /  x)[p(u'[n/X])/y]) 
i 

if  u  =  AX.i/(u')  G{u'[ri/X]}[»/(«'[r2/A'])] 

and  y  fresh,  (Ax  :  ^{^'[^2/ X\). 

(«{AAf.«'  y}[r,][r2] 

/  (out{u'[7^/X]}x))[i/(u'[r2/X])/y]) 
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t 

The  expression  ®{ti}[Ti][r2]  /  i ;  (u  i^)  is  well-defined  when 

•  /  :  n  t2, 

•  t  :u  Ti,  and 

•  X  occurs  only  positively  in  u  X,  i.e.,  ->Neg{X,u  X). 

Intuitively,  /  is  applied  to  the  appropriate  subterms  oft,  as  syntactically  directed 
by  the  type  constructor  u.  Similarly,  ^{«}[Ti][r2]  / 1  :  (u  ri)  is  well-defined  when 

•  /  :  n  -►  T5, 

•  t  :u  r2,  and 

•  X  occurs  only  negatively  in  u  X. 

The  reductions  which  allow  the  one-step  cancellation  of  inverse  constants 
are  the  significant  additions  to  previous  work.  In  other  papers,  functions  have 
had  to  simulate  these  constants  via  Corollary  1.  But,  without  these  inverse 
cancellation  reductions,  reduction  sequences  are  significantly  longer. 

The  operational  semantics  is  type  sound: 

Theorem  4  IfT\-t:a  and  t  v,  then  F  I-  v  : 

Proof  Sketch:  Each  evaluation  step  is  type  consistent.  □ 

It  also  guarantees  that  evaluation  terminates: 

Conjecture  1  then  there  exists  a  unique  value  v  such  that  t  u. 

Proof  Sketch:  By  the  translation  given  in  Appendix  B,  all  terms  can  be 
mapped  to  terms  in  f2-  The  translation  preserves  reduction,  i.e.,  t  — ►  u  implies 
t  Since  F2  is  strongly  normalizing,  any  evaluation  sequence  for 

which  respects  the  Fj.  translation  and  standard  semantics  must  terminate.  The 
evaluation  function  — ►  meets  this  requirement.  □ 


4  Inductive  Types 


Inductive  types  are  those  definable  with  the  ft  type  constructor.  They  represent 
tree  structures  of  finite  depth.  Some  examples  are 


Void  =  ti{XX.X) 

Nat  =  nlxx.l  +  X) 

List  A  =  filxX.l  +  A  X  X) 

BinaryTreeJ^  =  /i(XX.A  +  X  x  X) 
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binary  tree  with  labels  only  on  leaves 
AFancyTreCj^  =  ft{XX.A  +  AxXxX  +  AycX>iXxX) 
binary /ternary  tree  with  eill  nodes  labelled 
FancierTreeA,B  =  fi{XX.A  +  A  x  {B  X)) 

tree  with  B-branching  and  A-labelled  nodes 

By  convention,  the  definition  of  type  (•)^  has  a  free  type  variable  A,  and  (•),.  = 

While  inductive  types  are  usually  defined  in  the  form  ti{XX.Ti-{ - f-rw),  this 

is  not  necessary.  For  example,  FancierTrteA,B  is  isomorphic  to  fi{XX.A  x  (1  + 
{B  — ►  A))).  However,  any  inductive  type  not  isomorphic  to  Void  is  isomorphic 
to  some  type  given  in  the  conventional  form. 

Observe  that  if  X  does  not  occur  in  r,  then  /i(AX.r)  is  isomorphic  to  r. 

A  number  of  the  examples  in  this  section  2ire  adapted  from  [26]. 

4.1  Maps  to  inductive  types  (and  constants) 

It  is  helpful  to  first  examine  the  structure  of  inductive  constants  and  construc¬ 
tors.  Recall  that  from  a  categorial  perspective,  constants  2ire  isomorphic  to 
constructors  mapping  from  type  1.  The  patterns  are  most  easily  explained  by 
example. 

For  n(u)  =  Nat,  i.e.,  u  =  XX.l  +  X: 

0  =  in{u}(iiU  *y 

1  =  m{u}(inr  0) 

2  =  in{u}(inr  1) 

succ  =  Xn  :  Nat. in{u}(mr  n) 


For  /i(u)  =  ListA,  i.e.,  «  =  XX.l  +  A  x  X: 
null  =  AA.in{u}(inl  *)* 

[6]  =  in{u}(inr(ft,  na//[A])) 

[a,  6]  =  in{u}(inr{a,[6])) 

cons  =  AA.Xal :  A  x  £ts<^.m{u}(inr  al) 


For  fi{u)  =  BinaryTrecA  (abbreviated  BT a),  i  e.,  u  =  XX. A  +  X  x  X: 

•  c  =  in{u}(inl  c) 

=  in{u}(inr(in{u}(inl  o),  in{u}(inl  6))) 

•  a  •  b 


^Thea«  temu  are  very  similar  to  Church  numerals  if  coproducts  are  encoded  into  the 
remaining  calculus  in  the  standard  way.  E.g.,  0  S  in{u}(A^.Az  ;  Z.Xs  :  Nat  -*  Z.z)  and 
1  =  in{«}{AZ.Az  ;  Z.)is  :  Nat  — *  Z.s  0). 

’Remember  that  A  is  free  in  u! 
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leaf  =  AA.Xa  :  i4.in{u}(ml  a) 

makeBT  =  AA.Xti  :  BTa  x  BTx  in{u}(mr  it) 

As  seen  from  these  examples  and  from  its  type,  in{t<}  is  required  to  “pack¬ 
age”  a  term  into  the  type  /i(u). 

The  uncurried  forms  of  constructors  such  as  cons  and  makeBT  are  more 
natural  as  a  result  of  using  products  in  the  definitions  of  List  a  and  BinaryTree 

4.2  Inductive  functions:  Maps  from  inductive  types 

When  defining  an  inductive®  function  g  =  R{u}[t]/,  it  is  often  convenient  to 
use  one  or  both  of  the  tools  used  here.  One  method  is  to  give  a  set  of  recurrence 
equations  and  extract  the  function  /.  This  extraction  can  be  aided  by  using  the 
commuting  diagrams  of  F-algebras,  the  second  method. 

The  form  of  the  recurrence  equations  for  three  common  inductive  types  (each 
of  these  having  two  constructors)  is  given  here. 

Nat:  g  fi  * 

g(succ  n)  S  f^ig  n) 

List  A-  </(nji/f[A])  2  /i  * 

glcons[A]{a,l))  ^  f2{a,g  1) 

BTa-  9{leaf[A]  a)  2  /i  a 

g{makeBT[A]{ti,ti))  2  fi{g  ii,g  fj) 

where  /j  ;  rdr/A]  — ►  r,  and  f  =  Xx  :u  r.ca8e(®,/i,/2). 

Example  2  To  illustrate,  we  define  even?  :  Nat  — ♦  Bool  (assume  that  standard 
Boolean  functions  are  defined'®).  In  particular,  we  wish  to  satisfy  the  inductive 
recurrences 


even?  0  2  true  even?  {succ  n)  2  not{even?  n) 

The  first  equivalence  is  the  same  as 

even?  (0^  ♦)  2  irue^  * 

which  fits  the  form  of  recurrences  given  at  the  beginning  of  the  section.  (On 
following  examples,  we  leave  this  sort  of  expansion  to  the  reader.)  The  above 
are  equivalent  to  the  commutativity  of  this  diagram: 

®In  thia  context,  inductive  ia  equivalent  to  iterative,  rather  than  primitive  recursive.  As 
will  be  shown  in  Section  4.3,  iteration  is  aa  powerful  aa  primitive  recursion. 

'“These  definitions  are  straightforward  from  either  Bool  =  1  +  1  or  Bool  =  +  1). 

See  Appendix  A. 
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car[X](na//[i4])  S  ini  * 
car[yl](con5[i4](a,l))  2  inr(iri(a,  car[>l] /)) 

"This  definition  provides  “error  checking”,  i.e.,  detection  of  traditionally  erroneous 
caT[A](nult[A]),  via  coproducts.  Alternatively,  we  could  base  a  definition  on  the  simpler 
relations 

car[A](ntt//[A])  2  error  ear[A](coas(A]{a,l))  9i  »i  (o,  car[A]  1) 

for  some  cotutant  error  ;  A. 
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,  ,  Id  +  Id  X  car[A]  ^  , 

1  4-  >1  X  List  A - ^  1  +  A  X  (1  +  v4) 


[n«//[i4]^,  con5[j4]] 


ini  +  inr  o  Tti 


List  A 


car[A] 


1  +  ^ 


+  A  X  L}  f  t  =  case(<,  Xu  :  l.ini  ♦, 

Aal ;  A  x  Iwtyi  .inr{xi  a/,/(ir2  o/)}) 


/  =  Aji  :  1  +  a  X  +  A). 

ca8e(x,  Au  ;  l.ini  u,Ay  ;  A  x  (1  +  A).inr(irij/)) 
car  =  AA.R{L,  1  +  A  x  I}[1  +  A]/ 

A  typical  evaluation  sequence  of  an  application  of  car  is 

car[JVal]  [1,2] 

/(<5  (R[l  +  ^a<]/)(inr(l,(2]))) 

=  /(case(inr(l,[2]), 

Au  ;  l.ini  *, 

Xal :  A  X  ListA.iar{Tri  o/,  R[1  +  Nai]f{ir2  o/)))) 
/(inr{l.R[l  +  Aa/]/[2])) 
inr(iri{l,R[l  +  Ara/]/[2]}) 
inr(fl'i{l,2)) 

— ►  inr  1 

This  evaluation  sequence  requires  a  number  of  steps  linear  in  the  length  of  the 
list  as,  in  the  example,  R[1  +  Hat]f  [2]  95  carfiVat]  [2]  must  be  evaluated.  If 
pairing  were  lazy,  this  would  not  be  the  case,  and  car  would  only  take  constant 
time.  However,  a  better  definition  of  car  can  be  given,  as  in  Example  12,  which 
requires  only  constant-time  even  with  eager  pairing. 

Many  inductive  destructors  can  be  defined  in  a  similar  way.  The  other 
destructors  can  be  defined  inductively  as  in  Examples  6  and  7.  In  Section  4.4, 
we  will  show  a  much  simpler  way  to  define  all  of  these  destructors. 

Example  4  Test  whether  all  leaves  in  a  binary  tree  are  even  numbers. 

leavesEven?{leaf[Nat]  n)  95  even?  n 
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leavesEven'i{makeBT[Nat\{8,t))  S  and  {leavesEven?  s, 

leavesEven?  t) 

Nai  +  BTn^t  x  BT ‘  Nat  +  Bool  x  Bool 


[/ea/[iVo<],  makeBT[Nat]] 


[even?,  and] 


NT  Nat 


Bool 


leavesEven? 

Multiple  argument  functions  can  be  defined  via  currying  as  in  the  following 
example. 

Example  5  Addition  of  two  natural  numbers.  The  recurrences 

plus  0  n  S  n  plus  (succ  m)  n  S'  plus  m  (succ  n) 

are  equivalent  to 

plus  OS!  Id  plus  (succ  m)  a  An  :  Nai. plus  m  (succ  n) 

The  categorical  equivalent  of  currying  is  exponentiation: 

1  +  Nat - -  1  +  Nai  — ♦  Nat 


[0^ ,  succ] 


[Id,  Ay.y  o  succ] 


Nat 


plus 


Nat  — *  Nat 


f  =  A*  :  1  +  Nat  -*  Nat. 

case(a:,Au  :  l.Id^*** ,Xy  :  Nat  — ►  Nat.Xn  :  Nat.y(succ  n)) 
plus  =  R[iVal  — ►  Nat]f 


4.3  Primitive  recursion 

Simple  induction  is  a  valuable  tool,  as  the  previous  sections  shows.  However, 
it  is  also  overly  constrained  in  practice.  In  particular,  we  would  like  to  use 
the  more  convenient  notion  of  primitive  recursion  such  that,  for  example,  the 
following  recurrence  equations  hold. 
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Nai:  g  0  —  fi  * 

g{succ  n)  S  f3(n,g  n) 

List  a:  ff(na//[Aj)  /i  * 

3(cons[A](a,/})  S'  f^ia,  {l,g  /)) 

BTa:  g{Uaf[A]  a)  S  A  a 

g{makeBT[A]{ii,ti))  -  /2{(A,ff  h),{ti,g  t^)) 

It  is  well-known  that  induction  can  implement  primitive  recursion,  e.g.,  [20, 
26].  However,  such  simulation  is,  an  intuitive  sense,  frequently  too  inefficient. 
This  intuition  has  been  formalized  for  (the  Church  numeral  encoding  of)  natural 
numbers  by  Parigot  in  [24].  This  section  shows  examples  of  this  simulation, 
and  how  to  even  go  beyond  primitive  recursion.  Section  4.4  shows  how  this 
inefficiency  sometimes  can  be  avoided  in  . 

Example  6  Natural  number  predecessor.^^ 

pred  0  S  0  pred  (succ  n)  ^  n 

This  is  not  in  the  form  of  an  inductive  definition,  but  is  in  the  above  primitive 
recursive  form.  So,  since  inductive  types  can  also  be  encoded  in  pure  Fo,  it 
should  not  be  surprising  that  functions  such  as  pred  and  cdr  may  be  defined 
using  the  same  pairing  technique  common  in  F^: 

predPair  0  (0,0) 

predPair  (succ  n)  Sf  {succ{xi{predPair  n)),  rri{predPair  n)) 

In  particular,  this  definition  implies 


predPair  n  =  (n,  pred  n) 

pred  n  SS  K2{predPair  n) 


[0^ ,  succ] 


Nat 


predPair 


Nat  X  Nat 


**We  omit  error  checking,  e.g. 

pred  0  S!  ini  •  pred  (t%cc  n)  91  inr  n 

from  this  and  following  examples  for  simplicity. 
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/  =  Ai :  1  +  Nai  x  Nat. 

case(x,  Au  :  1.(0, 0), 

Ann  ;  Nai  x  Nat.{sitcc{iri  nn),7ri  nn)) 
predPair  =  R[JVa<  x  Nat]f 
pred  =  An  :  Nat.ir-i^predPair  n) 

Like  its  F2  counterpart,  this  dehnition  requires  linear  time,  even  with  al¬ 
ternative  definitions  of  — ►,  since  predPair  n  must  be  calculated  to  determine 
predPair{succ  n). 

Example  7  The  cdr  of  a  list  (such  that  cdr[A](nu//[A])  ntt//[A]),  using  the 

same  technique.  We  define 

cdr/’ttir[.4](nB//[.4])  S  {n«//[j4],  nn//[j4]) 
cdrPatr[i4](cons[yl]{a,l))  (cons[.i4](a,xi(cdrPotr[j4]  /)),  iri(cdrPa»r[yl]  /)) 

so  that 


1  -b  A  X  LiaiA 


cdrPair[A\  I  S  {/,  cdr[A]  1) 

cdr[i4]  /  ‘it2{cdrPair{A\  1) 

Id  +  Id  X  cdrPair[A] 


1  -1-  .A  X  {ListA  X  List  a) 


[n«ll[J4]^  cons[i4]] 


cdrPair[A] 


LisiA  X  LisiA 


f  =  Xx  :  1  +  Ax  (LisiA  x  LisiA)- 

case(i,  Au  :  l.(nii/f[i4],  nu//[i4]), 

Xy  :  A  X  (LisiA  x  LisiA)- 

{cons[>l](x,y,  ri(v2y)),  Xi(x2y)» 
cdrPair  =  A.A.R[Lisf,4  x  List  a]/ 
cdr  =  XI :  LisiA-^:i(cdrPair[A]  1) 

Example  8  The  factorial  of  a  natural  number. 


fact  0  1 


fad  (avcc  n)  “  times  n  (fact  n) 


Again,  the  above  definition  is  not  expressed  in  the  inductive  form,  and  we 
must  use  a  pairing  technique  similar  to  before,  with  the  relations 

faciPair  0  S  (0, 1) 
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factPair  {succ  n)  S  {avcc{iri(^factPair  n)), 

iimes  (succ(vi(faciPair  n)))  {v^ifactPair  n))) 
faciPair  n  SS  {n,fact  n) 

fact  n  Si  iTiifactPair  n) 

The  general  form  of  primitive  recursion,  recurring  over  an  inductive  type 
resulting  in  a  type  r,  is  given  by  the  following  commuting  diagram  [20]. 


Given  a  function  /  (this  corresponds  to  (/i,/?}  from  the  beginning  of  the 
section),  we  get 

/'  =  {in{u}  o  /) 

Since  the  rectangle  commutes, 

(/</''^“\pr{u}[r]/)  =  R{u}[p(u)  x  r]/' 

pr{w}[r]/  =  T2  o  (R{«}[/i(«)  x  r]/') 
pr{u}  :  Vr.(u  (a»(u)  x  t)  — ►  r)  — *  /i(u)  — ►  r 

Example  9  Primitive  recursion  for  natural  numbers  and  lists.  These  defini¬ 
tions  follow  the  tradition  of  separate  base-  and  inductive-case  functions  fi ,  in¬ 
stead  of  a  single  /. 

pr{XN.l  +  N}  = 

AA.Xfi  ■■  A.Xfi  :  {Nat  x  A)  —  A.An  ;  Nat. 

X2(R{AAr.l  +  N}[Nat  x  A] 

(Ay  :  1  -f  Nat  x  A. 

case(y,  A«  :  1.(0, /i). 

Ana  :  Nat  x  A.(succ(jri  no),/2  na))) 

n) 

pr{XL.l  Ax  L}  = 
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XB.Xfi  ;  B.A/j  ;  A  x  (LisiA  x  fl)  -♦  3.M  :  ListA- 
T2(R{B,  1  +  a  X  L}[LisiA  X  B] 

(Ay  ;  1  +  A  X  {LisiA  x  B). 
case(y,  A«  :  1.(0, /i), 

Xalb  :  A  X  {LisiA  x  B). 

(cons[A](iri  alb,tt\{ir2  alb)), 
h  alb))) 

1) 

Using  these  we  C2ui  define,  for  example, 

pred  =  pr{XN.l  +  N}[Nai]  0  (Ann  :  Nai  x  Nai.iri  nn),  and 
cdr  =  AA.pr{XL.l  +  A  x  L}[£is<>i] 

nii//[A]  {Xall :  A  x  {LisiA  x  iwt^).xi(ir2  all)) 

Extending  this  technique,  we  can  generalize  beyond  the  form  of  primitive 
recursion,  allowing  a  function  to  depend  on  i  previous  recursive  calls,  for  a 
given  fixed  i.  I.e., 

yOS/i  ...  y(i-l)“/.- 

g{i  +  n)  2  fi+i  (n,y  n, . . . ,  g{i  +  n  -  1)) 

% 

Primitive  recursion  in  the  traditional  number-theoretic  sense  corresponds  to 
prNai[Nai].  However,  using  induction  (or  primitive  recursion)  with  a  higher- 
order  type,  it  is  possible  to  define  functions  which  are  not  primitive  recursive  in 
the  traditional  sense.  The  common  example  of  such  a  function  is  Ackermann’s 
function. 

Example  10  Ackermann’s  function. 

ack  =  Am  :  Nat. 

R{AAr.l  -t-  N}[Nat  —  Nat] 

(Ay  :  1  -I-  Nat  — ►  Nat. 

case(y,  sKccl,  A/  :  Nai  — ►  Nai.Xn  :  Nat. 

K{XN.1  + N}[Nat] 

{Xz  :  1  -I-  Nat.case{z,  l^,  /)) 

{succ  n)) 
m 

4.4  Inductive  destructors 

Since  in{u}  is  used  to  obtain  the  constructors  for  an  inductive  type,  its  inverse, 
in"^{u},  gives  the  corresponding  destructors.  For  example,  the  destructor  for 
Nai  is  pred  and  those  for  LisiA  are  cor  and  cdr.  Now  observe  that  some 
destructors  require  linear  time  when  using  definitions  such  as  those  presented 
so  far.  Comparing  these  definitions  to  Corollary  1,  we  see  that  other  definitions 
using  in“^  are  available.  Due  to  the  reduction  rule  using  in“^,  these  new 
definitions  will  be  more  efficient. 
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ini  * 


Example  11  Using  the  inverse  of  in{AiV.l  +  JV}. 

in~^0  =  in“^(in(ml  *))  — ► 

in”^(siicc  n)  =  m~^(in(inr  n))  — ►  inr  n 

Again  defining  prtd  0  0,  we  can  define 

zero'!  =  An  :  Nat.caae{\vr^n,true^ ,Xn  :  Nai.false) 
pred  =  \n  :  Nat.caae(in~^n,Q^ ,Id^“*) 

And,  we  can  compare  this  to  Corollary  1  with  the  following  diagram  (both 
triangles  commute)  and  definitions; 


1  +  Nai  +  (1  +  Nat) 


Nat - ; - -  1  +  Nat 

m~ 


f  =  Ai :  1  +  (1  +  JVa<).case(x,A«  :  l.inl  u,  Ay  ;  1  +  Aot.inr(in  y)) 

S  R[1  +  Nat]f 

This  operational  equivalence  empirically  confirms  the  corollary. 

Unlike  the  definitions  for  pred  given  in  the  previous  section,  this  is  constant¬ 
time.  For  example,  where  n  is  a  value, 

pred{succ  n) 

case(in”*(in(iiir  n)),  0^ 

— ►  ca8e(inr  n,  0^ 

— ►  n 

Example  12  Using  the  inverse  of  m{£,  1  -1-  A  x  L). 

in~'(n«//[A])  =  in~*(in(ml  *))  ini* 

in“^(cons[A](a,/))  =  in~^(in(inr{a,/)))  inr{a,/) 

nti//?  =  AA.Xl :  £wt^.ca8e(in~*/,  irwe^,  Ao/ :  A  x  ListA-false) 

car  =  AA.Xl  :  iislx  .ca8e(in~‘/,A«  :  l.inl  *,Aa/  :  A  x  i«s<>i.inr(xi  al)) 

cdr  =  AA.Xl :  ListA.case(in~^l,Xu  :  l.inl  ♦,Aof ;  A  x  Ljstyi.inr(ir2  al)) 
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5  Co-inductive  Types 

The  dual  of  inductive  types,  co-inductive  types  are  defined  with  the  v  type 
constructor.  They  represent  tree  structures  of  potentially  countably  infinite 
depth.  Some  examples  are 

Natu  =  +  N) 

natural  numbers  and  their  limit  u 
Stream  A  =  i/(A5.1  +  .<4x5) 

finite  and  infinite  length  streams 
InfStreamj^  =  i/(\S.A  x  S) 

infinite  length  streams 
=  v(\X.A  X  Listx) 

finite  branching,  infinite  depth  trees 
FancierlTrte a,b  =  v(\X.A  +  i4  x  (B  -+  X)) 

B-branching,  potentially  infinite  depth  trees 

For  each  co-inductive  type,  there  are  terms  of  that  type  which  represent 
objects  of  infinite  size.  For  types  such  as  Stream  a  ,  there  are  also  terms  which 
represent  finite-sized  objects. 

The  dual  types  fM{u)  and  t/(u)  represent  similar  collections  of  objects.  For 
example,  ListA  and  Stream  a  both  represent  sequences  of  elements  of  type  A. 
The  co-inductive  type  is  isomorphic  to  its  dual  inductive  type  plus  some  infinite¬ 
sized  objects.  Another  example  of  this  correspondence  is  between  Nat  and  Natu. 

5.1  Co-inductive  functions  and  simple  terms:  Maps  to  co- 
inductive  types 

For  co-inductive  types,  there  are  two  convenient  definition  methods  for  simple 
terms  and  constructors.  The  first  is  based  on  dualizing  inductive  simple  terms 
and  constructors.  Later  examples  will  point  out  a  method  using  the  categorical 
idea  that  constants  of  type  <t  are  obtauned  from  maps  of  type  1  — ►  <r. 

For  i/(u)  =  Natu,  i.e.,  «  =  XN.l  -F  N'. 
zeroNatu  =  out“'{«}(inl  ♦) 
succNaiu  =  An  :  lVa<w.out“‘{«}(iiir  n) 

Note:  u  must  be  defined  using  the  second  method.  See  Example  20. 

For  i/(u)  =  SireamA  (abbreviated  StrA),  i.e.,  u  =  AS  1  -I-  A  x  5; 
emptyStream  =  AA.out“*{u}(inl  ♦) 

[a, 6]  =  out“'{«}(inr(a,out~*{«}(inr(6,  emptyStream[A])))) 
consStream  =  AA.Aas  :  A  x  Sireom^. out” '{u}(mr  as) 

For  i/(u)  =  InfStreamA  (abbreviated  IStrA),  i.e.,  «  =  XX. A  x  Listx  '• 
consIStream  =  AA.out”‘{u} 
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Due  to  duality,  maps  to  co-inductive  types  are  similar  to  maps  from  inductive 
types,  in  that  such  functions  involve  the  induction  operator  and  commuting 
diagrams. 

However,  the  general  recurrence  patterns  of  co-induction  are  not  as  con¬ 
venient  as  those  of  induction  as  shown  in  Section  4.2.  To  define  a  function 
g  =  G[X]f  :  X  — ►  v{\X.t),  the  recurrence  equations  of  co-induction  for  the 
above  three  types  are 

Naiu:  5  i  =S  case(/  x,zeroNaiu^,Xy  :  X.succNaiu(g  y)) 

StrA-  ff  I  —  case(/  x,  empiyStream[A]\ 

Xax  :  A  x  X .consSiream[A]{‘trY  ax,g(ir2  ax)}) 
ISivA-  g  X  —  consIStream[A]{iri{f  x),g{ir2{f  *))) 


Example  13  The  empty  stream  (alternate  method).  Using  the  idea  that  the 
constant  is  essentially  a  map  of  type  1  — ►  Stream  a,  we  use  the  general  pattern 
of  co-induction  on  streams. 


14-^  X  1 


Id  Id  -x.  emptySiTeam[A^ 
- -  1  -I-  A  X  StrA 


f  ~  ini 


out 


1 


emptyStream[A^ 


StrA 


<5{A5.j4  X  5}[l][5<rx]  ft  —  case(t,  Au  :  l.inl  *, 

Afltt  ;  A  X  l.inr{iri  oii,/(x2  au))) 


emptyStream  =  Ayl.G{A5.1  +  Ax  5}{1](A«  :  l.inl  u)* 

Evaluation  of  out(cmp<y5<ream[A]): 
out(  emptyStream  [A]) 

— ►  ^  (G[1](A«  :  l.inl  «))  ((A«  :  l.inl  u)  *) 

=  case((Au  ;  l.inl  u)*, 

Au  ;  l.inl  *, 

\au  :  A  X  l.inr({xi  a«,G[l](Au  :  l.inl  u)(7r2  a«)})) 

— ^  ini  ♦ 
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Example  14  Siinil2u:ly,  we  can  define  consIStream  using  this  alternate  method, 
and  compare  the  result  to  Corollary  1.  It  fits  into  the  above  recurrence  pattern 
as 

consIStream[A]{a,s)  S  con5/sfreani[A]{a,  cons/5fream[i4](out  s)) 
since  consIStream[A]  S  out~^. 


.  /  ■  .  Id  X  cons/5freomrj4] 

Ax  {Ax  ISIta) - -  A  X  IStr^ 


Id  X  out 


out 


A  X  IStrA 


consIStream[A] 
${A5.A  X  5}[A  X  /5<r^][/5<r^]  /  f  = 


ISiry, 


f  2  Aas  :  A  x  IStrA-iwi  as, out(ir2  as)) 

conalSiream  =  Ai4.G[A  x  IStvA]/ 

Unfortunately,  destructmg  a  term  built  using  this  definition  is  computation¬ 
ally  expensive.  In  essense,  destructing  a  stream  built  with  this  consIStream 
propagates  the  out  found  in  the  above  definition  of  /.  E.g.,  given  any  is  : 

ISireamffat, 

tailIStr[A]{consIStream[A] ( 1 ,  is) ) 
T2(out(cons/5<ream[i4](l,  is))) 

^  X2(<^  iG[A  X  IStVA]/)  (f{l,  is))) 

=  ’r2((»-i(/{l.w)),G[A  X  /5<rx]/(x2(/(l,is))))) 

G[j4  X  /5fr^]/(out  is) 

The  last  term  in  this  reduction  sequence  is  observationally  equivalent  to  is, 
but  computing  the  headlSir  or  taillStr  of  this  stream  requires  a  longer  re¬ 
duction  sequence  than  does  destructing  is.  Using  the  previous  definition  of 
consIStream  =  out"'  avoids  this  problem  since 

7r2(loi//5<r[i4](out"'{l,  is)))  is. 

So,  just  as  the  inverse  of  in{u}  efficiently  defines  an  inductive  type’s  destruc¬ 
tors,  the  inverse  of  out{u}  produces  efficient  co-inductive  constructors. 
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Example  15  The  infinite  stream  of  natural  numbers  from  a  given  one,  e.g., 
natsFrom  2  S  I2,3,4, . . .].  From  the  relation 

natsFrom  n  S  consISiream[Nat]{n,  natsFroTn(succ  n)) 

we  can  obtain  the  equivalent 


out  (natsFrom  n)  2  (n,  natsFrom  (succ  n)) 

which  is  the  natural  counterpart  for  the  commuting  diagram 

,  Id  X  natsFrom  „  , 

Nat  X  Nat - -  Nat  x  IStrfjat 


(Id,  succ) 


out 


- natsFi^m 

natsFrom  =  G[^a<](Aff ;  Nat.(n,succ  n)) 

Example  16  The  infinite  stream  of  a  constant  c  :  i4.  The  recurrence 
consiIS[A]c  2  cons/Slream[j4]{c,  const/5[i4]c) 
leads  to  the  definition 

consilS  s  Ai4.Ac  :  i4.G{AS.yl  x  S}[l](Au  ;  l.(c,u})  * 

Example  17  The  infinite  stream  of  factorial  numbers.  We  first  define 

factsHelp  (m,n)  2  consIStream[Nat](n,factsHelp  (times  m  n,succ  n)) 

which  encapsulates  the  incremental  computation  of  the  factorials.  To  define  the 
stream  of  all  factorials,  we  must  seed  the  computation  with  some  numbers,  in 
this  case  the  first  factorial  number  and  the  first  number  to  multiply  by: 

facts  =  factsHelp  (1, 1) 

Nat  x  (Nat  x  Nat)  ^  hctsHelp  ^  ^  ISirnat 


f 


out 


Nat  X  Nat 


factsHelp 


IStrf/at 
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/  =  Ann  :  Nat  x  Nat. 

{ni  nn,  {times  (iti  nn)  (jr2  nn),succ{ir2  nn))) 
facisHelp  =  G[Nat  x  Nai]f 
facts  =  factsSetp  (1,1) 

Example  18  The  infinite  stream  of  Fibonacci  numbers 

fibsHelp  (m,  n))  2?  consIStream[Nat]{m,fibsHelp  {n,plus  m  n)) 

f  =  Ann  ;  Nat  x  Nat.(Tri  nn,{it2  nn,plus  (xi  nn)  (ir2  nn))) 

fibsHelp  =  G[Nai  x  Nat]f 
fibs  =  fibsHelp  (0, 1) 

Example  19  Appending  two  streams.  The  following  definition  is  based  on  the 
relations 


appStr[A]{e,e)  S'  e 

appStr[A]{e,consSir[A]{a,s))  S  cons5fr[A](a,  flpp5<r[.4]{e,s)) 
app5/r[A](consSfr[i4](a,s),t)  2£  cons5fr[A](a,  appS<r[>l](s, <)) 

using  the  abbreviation  e  =  emptyStream[A\. 

Using  destructors  defined  in  Section  5.3  and  boolean  functions  defined  in 
Appendix  A, 

/  =  Ass  :  StvA  X  StTj^. 

ite  (emp<yS<reom?[A](xi  ss)) 

(ite  (emptyStream?[A]('ir2  ss)) 

(ini  ♦, 

inr(Aearf5fr[i4](7r2  ss),  (ini  *,tailStr[Aj(ir2  ss)))) 
inr(Aead5<r(A](xi  ss),{tailStr[A]{rri  ss),ir2  ss))) 
appSir  =  \A.G[StrA  x  Strji]f 

Example  20  The  term  w  •  Nntu>.  The  desired  equality  w  2S  succNatw  w  is 
equivalent  to  out  (a»f  ♦)  S  inr(w^  ♦).  So,  we  have  w  =  G[l](Au  :  l.inr  u)  *. 
Note  than  an  alternate  definition  for  zeroNatu  is  the  very  similar  G[l](Au  : 
l.inl  u)  «. 

Since  Natu  is  isomorphic  to  Sfreomj,  we  can  adapt  Example  19  to  define 
(non-curried)  addition  on  Natui: 

f  =  Ann  ;  Natu  x  Natu. 

ite  {zeroNatul{Ki  nn)) 

{ite  {zeroNatu?{ir2  nn)) 

(ini  «,inr(inl  *,predNatu{ir2  nn))) 
int{predNatu{iri  nn),  7r2  nn)) 
plasNatu  =  G[Naiu  x  Natw]f 
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5.2  Primitive  co-recursion 

Dualizing  the  diagram  for  primitive  recursion,  we  obtain  the  following  commut¬ 
ing  diagram  [20]. 


So,  given  a  function  /,  we  find  f'  by 

f  =  [(${«}  ini)  oout{u},/] 

Then,  since  the  rectangle  commutes, 

[Id,pcor{u)[T]f\  =  G{u}[i/(u)  -1-  r]/' 

So, 

pcor{u}[T]f  =  inro  G{u}[j/(u)  +  r]f' 

pcor{u}  ;  VT.(r  — ►  u  (i/{u)  -1-  r))  —►  r  — ►  i/(u) 

Recurrence  equations  for  a  primitive  co-recursive  function  g  would  be  based 
on  the  equation 

X  “  ${«}  (Ay  ;  i/(u)  -1-  X.case(y,  Id''^'‘\g))  (/  x) 
for  each  constructor  u. 

Example  21  Translating  the  definition  of  pcor  into  syntax  leads  to, 

for  example, 

pcor{Naiu/}  =  \A.Xf  ;  ►  1  +  {Natw  +  A).Xx  :  A. 

inr(G{A^a^w}[yVa<a/  +  A] 

(Ay  :  Natu  -1-  A. 

case(y.  An  ;  Natw. 

case(out{AN.l  N}n, 

Xu  :  l.inl  *, 

Am  :  7\fa<w.inr(inl  m)), 

f)) 
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An  example  of  pcor  is  the  zip  function,  which  maps  a  pair  of  streams  into  a 
strerun  of  pairs. 

zipIS  =  AA.pcor{XS.A  x  5}[/5a  x  /5^] 

(Ass  :  ISa  X  ISa- 

{(headIStr[A](vi  ss),headIStr[A\(ir2  ss)) 
inT{iailIStr[A]{iri  s3),tailIStr[A]{n2  ss)))) 

Notice  the  similarity  in  structure  to  the  definitions  of  appStr  and  plusNaiu 
which  could  also  be  defined  via  primitive  co-recursion. 

5.3  Maps  from  co-inductive  types 

The  use  of  out{w}  is  characteristic  of  such  functions  from  co-inductive  types,  as 
it  “unrolls”  or  “forces”  an  object  one  step,  the  only  way  to  access  the  information 
packaged  by  G{u}.  The  simplest  examples  of  its  use  are  destructors  and  base- 
case  tests. 

Example  22  Test  for  the  empty  stream. 

empiyStream?  =  AA.As  ;  5<r^.case(out  a,  irue^,\aa  :  A  x  SirA-false) 

Example  23  The  head  and  tail  destructors  for  streams. 

headStr  =  AA.As  :  5<rA.case(out  s,  Au  :  l.inl  ♦, 

Xas  :  A  x  5<r4.mr(xi  as)) 
tailStr  s  AA.As  :  5<r4 .case(out  s,  Au  :  l.inl  *, 

Xas  :  A  x  5<r^.inr(ir2  “*)) 

headlStr  =  AA.As  :  IStrA  'iri{out  s) 
taillStr  =  AA.As  ;  ISitA-if 2{out  s) 

Example  24  Maps  from  Natu. 

zeroNaiu?  =  An  ;  Naiu.case(ont  n,  <rue^.  Am  :  Natu. false) 
predNatu  ~  An  ;  Aa<w.ca8e(out  n,  zero\  Am  :  Natu.m) 

As  desired,  predNatu  u  w. 

The  function  w?  cannot  be  defined.  Since  out“^  provides  the  only  way  to 
“unroll”  and  examine  an  object  of  type  Natw,  the  only  way  to  define  such  as  test 
is  by  the  above  destructors.  Thus,  such  a  function  would  have  to  decrement  its 
argument  until  zeroNatu  was  obtained,  so  it  cannot  be  written  in  the  calculus. 
Similarly,  any  such  test  of  infiniteness  on  any  co-inductive  type  is  impossible. 

Example  25  The  function  nextnode  returns  the  next  node  of  the  tree  paired 
with  a  new  tree  with  which  to  continue  the  search. 
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nextnode  =  \A.M  :/n/7>iec^. 

{Ti(out  i), 

makelT A  {iri (out( cor[A] (ffa (out  t ) ) ) ) , 
af‘ptnd[InfTne 

(c<ir[yl](3‘2(out  t)), 
ir2(out(car[>l](7r2(out  t))))))) 

where  makelTA  =  out~^  is  the  constructor  for  InfTreeA- 

Repeated  uses  of  nextnode  results  in  breadth-first  search  of  a  finitely  branch¬ 
ing  infinite  tree: 

search[A]t  conslS[A\{itx{nextnode[A\t),  search[A](nextnode[A]t)) 
search  =  A^.G{AS.>i  x  S}lITA](nextnode[A]) 

Thus,  searcA[A]t  is  an  infinite  stream  of  the  nodes  of  i  in  breadth-first  order. 

8  Summary  of  Related  Work 

Hagino  [8,  9]  uses  a  generalization  of  algebras  called  di-algebras.  This  allows 
him  not  to  assume  any  base  types  or  the  constructors  +  and  x.  Instead,  all 
types  are  defined  with  a  p  or  i/  constructor  and  a  possibly  empty  list  of  functors 
corresponding  to  the  rj’s  in  -1 - b  Tn). 

Coquand  and  Paulin  [5],  and  Pfenning  and  Paulin-Mohring  [25]  are  similar 
in  that  they  also  do  not  assume  any  base  types  or  the  constructors  -(-  and  x. 
However,  they  do  not  work  in  a  category  theoretic  framework  and  they  use 
inductive,  but  not  co-inductive  types. 

Mendler  [20]  explains  primitive  recursion  and  its  dual  in  terms  of  category 
theory,  using  a  generalization  of  algebras.  Using  these  as  primitives  instead  of 
(co-)induction,  a  calculus  using  the  ideas  outlined  would  allow  constant-time 
encodings  of  our  inverses. 

Pierce,  Dietzen,  and  Michaylov  [26]  present  an  example-based  tutorial  on 
progr2imming  in  the  Fi  hierarchy  of  calculi,  using  iterators  for  inductive  types. 

Both  Leivant  [12]  and  Parigot  [22,  23,  24]  view  programs  with  inductive 
data  types  as  being  derived  from  proofs.  Leivant  formalizes  the  extraction  of 
programs  from  several  families  of  calculi,  giving  numerous  examples.  Instead 
of  extending  a  calculus  to  improve  efficiency,  Parigot  examines  alternate  en¬ 
codings  of  Nat  in  (optionally  extended  with  fix)  which  allow  constant-time 
destructors. 

Michaylov  and  Pfenning  [21]  describe  a  process  to  compile  F2  terms  to  Fo 
extended  with  constants  for  inductive  constructors  and  recursors.  It  translates, 
for  example,  the  common  pair-based  pred  function  similar  to  Example  6  to  a 
constant-time  function  using  recursors.  A  more  systematic  approach  to  defining 
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the  extension?  in  thei*  targ>;t  calculn?  could  be  obtained  from  o’lr  ;•  types  and 
related  terms. 

Leivant  [13]  looks  at  Church  numerals  in  a  predicative  version  of  F2,  describ¬ 
ing  precisely  what  computations  can  be  defined  on  that  type.  When  adding 
inductive  types  to  this  stratified  calculus,  he  shows  that  the  type  /rX.r  is  at  the 
same  level  as  r.  In  ,  this  means  than  fi(XX.r)  is  a  type  and  not  a  type 

scheme.  He  also  proves  that  the  addition  of  inductive  types  “does  not  result  in 
new  functions  being  representable,  but  it  does  allow  new  algorithm^’ . 

Burstall  [4]  extends  ML  with  an  inductive  case  statement,  and  relates  pro¬ 
gramming  with  inductive  types  to  specification  with  abstract  data  types,  an¬ 
other  area  which  uses  initial  algebras  and  sometimes  final  co-algebras.  Hagino 
[10]  extends  ML  with  a  “codatatype”  declaration  and  a  “merge”  statement 
which  corresponds  to  G.  Wraith  [27]  uses  a  rougher  equivalent  system.  Both 
notations,  however,  assume  definitions  of  co-inductive  types  are  of  the  form 
u{XX.ri  X  ■  ■  ■  X  r„),  which  makes  use  of  types  such  as  Stream  a  inconvenient. 

Crole  [6]  gives  a  model  for  an  inductive  calculus. 

With  the  assumption  that  C  is  the  category  of  CPO’s,  Meijer,  Fokkinga,  and 
Paterson  [15,  7]  eliminate  the  distinction  between  least  and  greatest  fixed  points. 
Thus,  in~^{u}  =  out{u}.  This  allows  additional  elegant  recursion  schemes,  but 
introduces  non-strictness. 


7  Conclusions 

Algebraic  datatypes  are  a  valuable  abstraction  for  programming,  as  terms  are 
easily  defined  directly  from  their  specifications,  i.e.,  recurrence  equations  or  sim¬ 
ple  category  theory  diagrams.  Using  the  morphisms  in"'  and  out"'  provides 
straightforward  means  of  obtaining  constant-time  inductive  destructors  and  co- 
inductive  constructors,  which  significantly  improves  efficiency  as  compared  to 
similar  calculi.  It  has  also  been  shown  that  conceptually  infinite  objects  can 
be  used  with  ease.  However,  when  termination  is  guaranteed,  the  usefulness 
of  co-inductive  datatypes  is  significantly  restricted,  as  many  common  functions 
cannot  be  defined. 


8  Comments  and  Future  Research 

The  calculus  as  presented  is  rather  verbose  from  explicit  types.  Type  inference 
should  be  explored  to  eliminate  or  reduce  the  amount  of  explicit  type  infor¬ 
mation  necessary.  A  ML-like  type  declaration  facility  together  with  pattern 
matching,  as  in  [4,  27,  10]  would  also  be  useful,  but  work  still  needs  to  be  done 
for  co-inductive  types. 

A  formal  model  of  the  calculus  would  involve  formalizing  the  points  raised 
in  Section  2,  in  particular,  detailing  the  structure  of  the  “category  of  all  types”. 
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It  would  be  interesting  to  base  the  calculus  on  the  full  calculus,  rein¬ 
troducing  higher  kinds.  In  that  case,  it  is  more  difficult  to  enforce  the  positivity 
constraint  on  (co-)inducuve  types  that  ensures  that  $  is  well-defined.  Alterna¬ 
tively,  dropping  the  positivity  constraint  altogether  introduces  non-termination 
and  requires  redefinition  of  the  evaluation  of  R  and  G,  since  $  is  not  always 
definable.  [14] 

The  syntax  of  the  calculus  creates  one  unfortunate  semantic  problem.  It 
is  not  Church-Rosser  when  using  the  standard  q  rule  and  an  inductive  »7-like 
rule  corresponding  to  Theorem  2,  R{«}[/i(M)]in{u}  t  < — ►  t.  In  this  case,  the 
diamond  property  does  not  hold  for  \x  :  p(u).R{u}[/i(u)]in{u}  t.  A  simple 
fix  is  to  only  allow  “fully  applied”  forms  such  as  R{u}[r]/  t  to  be  terms. 
The  problem  does  not  seem  to  arise  with  the  alternate  inductive  r;-like  rule, 
R{«}[/z(«)]in{«}  ^ 

More  could  be  learned  about  (co-)inductive  terms  in  F2  by  translating  our 
examples,  for  example,  as  shown  in  Appendix  B.  Also,  we  would  like  to  examine 
more  closely  the  duality  of  types  /i(u)  and  i'(u).  Furthermore,  our  familiarity 
of  co-inductive  constructs  is  still  not  as  developed  as  our  understanding  of  pro¬ 
gramming  with  inductive  types.  More  examples  could  come  from  extracting 
co-inductive  programs  from  proofs. 
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A  Other  functions 

The  most  direct  definition  of  Bool,  with  some  typical  functions: 

Bool  =  1-1-1 
true  =  ini  * 

and  =  Xbb  :  Bool  x  Bool.case{iri  bb,ir2  bb,  false) 

He  =  A6  :  Bool.Xaa  :  A  x  A.case(6,  Au  :  l.xi  aa,  Au  :  1.7r2  00) 

An  alternative  definition,  allowing  use  of  the  iterator  R  to  define  He: 

Bool  =  fi(XX.l  -1- 1) 
true  =  in(inl  *) 

and  =  A66  :  Bool  x  Boo/.case(Ti (in”’ W), ir2(m~* 66), /o/sc) 

He  =  A6  ;  Bool.R[A  x  A  — ►  A](Ai :  1  -I-  l.ca8e(a:,  Au  :  l.Aao  ;  A  x  A.iri  aa, 

Xu  :  l.Xaa  :  A  x  A.jr2  <*<»)) 

Some  other  basic  functions  on  natural  numbers;  note  the  similarity  of  monus 
and  plus  (Exercise  5): 
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eq?  =  R[JVat  — ►  Boot] 

(Ax  :1  +  Nat  — +  Bool. 

case(x,  2ero?\\y  :  Nat  —*  Bool.Xn  :  Nat.y(pred  m)) 
leql  =  R[iVo<  — +  Bool\ 

(Ax  :  1  +  Nat  —*  Bool. 

case(x,  Atx  :  l.An  :  Nat.true, 

Xy  :  Nat  —*■  Bool.Xn  :  Nat. 

ite  (zero?  n)  {false, y{pred  n)))) 


monusHelp  =  R[iVo<  — ►  Nat] 

(Ax  :  1  +  Nat  — ►  Nat. 

case(x,  Xu  :  l.Id^‘‘*, 

Xy  :  Nat  —*■  Nat.Xn  :  Nat.y{pred  m)) 
monus  =  An  :  Nat.Xm  :  Nat. monusHelp  m  n 

divrem  =  R[iVa<  — *  {Nat  x  JVat)] 

(Ax  :  1  +  Nat  — ►  {Nat  x  Nat). 

case(x,  Au  :  l.Am  ;  Nat. {0,0), 

Xy  :  Nat  (Nat  x  Nat).Xn  :  Nat. 
ite  (eg?  {^^{y  n))  {pred  n)) 

(s«cc(iri(y  n)),0) 

(iri(j/  n),  succ{T2{yn))}) 

div  =  Am  ;  Nat.Xn  :  Nat.iri{divrem  m  n) 

Ttm  =  An  :  Nat.Xm  :  Nat.it2{divrtm  m  n) 

diff  =  prNat{Nat  —*  Nat]  Id^“* 

(Ax  :  Nat  x  {Nat  — ♦  Nat).Xn  :  Nat. 

ite  {zero?  n)  {succ{'Kix),  {n2x)  {pred  n))) 

Filtering  and  accumulating,  on  a  list: 

filter  =  Ap  :  A  — >  Bool. 

R[£w<a](Ax  :  1  +  a  X  List  A. 

case(x,  Au  :  l.inl  *, 

Xal :  A  X  ListA-He  (p(5ri  al))  {al,ir2  al))) 
accum  =  R[((A  x  B)  —*  B)  —*  B  —*  B] 

(Ax  :  1  +  A  X  (((A  X  fl)  —  5)  —  S  —  B). 
case(x,  Au  :  l.A/  :  (A  x  B)  — ►  B.Id^ , 

Ay  :  A  X  (((A  x  B)  —  B)  —  B  B). 

A/  :  (A  X  B)  —  B.Xb  :  B. 

(’»’2y)  /  (/(iriy,6)))) 

The  equivalent  functions  on  streams  are  not  total  and,  therefore,  not  definable 
in  the  calculus. 

Merging  sorted  infinite  streams,  allowing  duplicates; 
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mergelS  =  AA.G[ISa  x  ^Sa] 

(Ass  :  IS  A  X  ISa- 

ite  (/eg?  (Aeai/5/r[yl](Ti  ss))  {headIStr[A]{ir2  ss))) 
{{headIStr[A]{Tri  ss),{iailIStr[A]{Tri  ss),Tr2  ss)), 
\keadIStT[/^{v'i  ss),  (iri  ss,iailISir[A]{'K2  ss))))) 

The  type  Unit  =  u(XX.X)  is  the  dual  to  Void  eind  thus  isomorphic  to  1. 
Adapting  examples  from  the  isomorphic  type  InfStream-i, 

unit  =  G[l]/</^  ♦ 

Id^’**‘  S  out~^  2S  G[f/»u<]out  2  out 

Many  more  inductive  type  examples  can  be  adapted  from  [3]. 


B  Translation  to  F2 

Since  F2  has  figured  prominently  in  the  work  on  (co-)inductive  types,  we  give  a 
translation  from  to  F2.  Type  and  term  variables  occurring  only  on 

the  right-hand  side  of  the  equations  are  assumed  to  be  fresh. 


X  =  X 
1  =  'iX.X^X 


<Tl  X  (T2  =  VX.(£j_  —»  (r2  —»)—>■  jy 

0-1  +<72  =  VX.(ffl-*X)^iff2-*X)^X 

a  —*  a'  s 

h{XX.t)  =  'iX.{T-*X)^X 

ujXX.r)  =  vy.(VA-.(Ar  —  r)  —  A  —  y)  —  y 


VA.<7  =  VA.<7 

£ 

X 

± 

= 

AX.Xx  :  X.x 

{tijh) 

AX.Xp  :  -♦  £2  — ►  X.p  <1  <2 

(if  ti  :  (Ti) 

ITjt 

= 

<[^(A/ :  £j^.Ar  :  ^./)  (if  t  :  <7i 

X  tr?) 

1T2t 

/[^(A/  :  £i.Ar  :  £2-7}  (if  /  :  <7i 

X  <72) 

inl^^t 

AX.Xl :  £i_ A.Ar  -.^-^XAt 

(if  /  :  <7i) 

inr"*/ 

= 

AX.Xl :  £1  — ►  X.Xr  :  <72  — +  X.r  i 

(if  t  :  0-2) 

case(f,<i,f2) 

= 

ilsltk  h.  U  ■  (Ti  <7) 

Xx  :  ff.t 

Ax  ;  z-t 

AX.t 

= 

AX.t 
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ii  ^2  =  li  ll 

in{w}  =  Xh  :  u  fi{u).AY.Xf  :  u  Y  — ►  Y. 

mMMum  (R{u}\Y]f)  h) 

■  ti  (u  /i(M)).R{u}[u  p(u)](${u}[u  /j(u)][/i(u)]  in{M}  t) 

R{u}M/  =  ■  /^(«)  <[l]/ 

out{u}  =  Xt  :  i/{u).i[u  u(u)]{AY.Xf  :  Y  — ►  u  Y.Xx  :  Y. 

^{ti}[y]Ku)]  (G{u}[y]/)  if  X)) 
out~^{u}  =  Xt  :  u  t/(u).G{ti}[u  i/(u)](${u}[2/(t<)][ti  i^(u)]  out{u}  t) 
G{u}[r]/  =  Ax  ;  r.AZ.Xh  :  iyW.{W  —  u  W)  —  Vy  —  Z.h\r]f  x 

This  translation  maps  A^^'**'  types  into  F2  types  which  are  closely  related 
to  the  standard  Fj  encodings  of  these  types.  For  example, 

Nat  =  'iZ.{iyX.X  —  X)  —  Z)  —  (Z  —  Z)  —  Z 

which  is  isomorphic  to  VZ.Z  —*  {Z  —*  Z)-*  Z,  the  normal  definition. 

Naturally,  using  the  definition  of  pnd  in  Example  6,  pred  is  similar  to  the 
standard  F2  definition.  However,  translating  Example  11  (and  simplifying  with 
isomorphisms  for  readability)  results  in  an  alternative: 

pred  Sff,  An  :  Nat.ln^iZ.Z  -*  (Nat  — ►  Z)  — »  Z] 

(AZ.Ax  :  Z.As  ;  M.  —  Z-^) 

(Ay  ;  (VZ.Z  —  {Nat  —  Z)  —  Z). 

(AZ.Az  :  Z.Xa  :  Nat  —  Z. 

s{y^Z.Z  —  {Nat  —  Z)  —  Z]  0  s«cc)))) 
[Nat\  0  Id^“* 

However,  even  using  this  definition,  it  requires  linear- time  to  evaluate  pred  n, 
since  Fj  does  not  have  an  one-step  equivalent  of  in~^(in  t)  — ►  t. 
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